AudioCanvas: Interactive Audio Photos

Visualizers based on Audio Processing

This project will automate the process of forming visual shows based on audio processing. Similar to the way computer based visualizers parse audio files, this project will process audio signals and use them to generate a photo visualizer. Based on different properties of music such as beat, tempo, frequency range, and volume, it’s possible to map these properties onto a photo visualizer design...

Designing audio-enhanced paper photos for older adult emotional wellbeing in communication therapy

This article introduces audio-enhanced paper photos enabled by digital pen technology as an interaction paradigm for supporting and understanding emotional wellbeing in late adulthood, particularly in the context of communication therapy activities and related social interactions. We describe the development of a multimodal pen-based system that enables creation of audio-enhanced paper photos a...

Enhancing research publications using Rich Interactive Narratives.

It is desirable in many disciplines to include supplementary information to add value to research publications, particularly in digital form. The concept of interactive publications, in which the reader can browse and navigate through in a nonlinear manner, is one such medium that is explored in this paper. We describe the application of the Rich Interactive Narrative framework to provide such ...

Making oral history accessible over the World Wide Web

We describe a multimedia, WWW-based oral history collection constructed from off-the-shelf or publicly available software. The source materials for the collection include audio tapes of interviews and summary transcripts of each interview, as well as photographs illustrating episodes mentioned in the tapes. Sections of the transcripts are manually matched to associated segments of the tapes, an...

Representing Audio Narrations of Photos